Automatic multispectral MRI segmentation of human hippocampal subfields: an evaluation of multicentric test–retest reproducibility

Accurate and reproducible automated segmentation of human hippocampal subfields is of interest to study their roles in cognitive functions and disease processes. Multispectral structural MRI methods have been proposed to improve automated hippocampal subfield segmentation accuracy, but the reproducibility in a multicentric setting is, to date, not well characterized. Here, we assessed test–retest reproducibility of FreeSurfer 6.0 hippocampal subfield segmentations using multispectral MRI analysis pipelines (22 healthy subjects scanned twice, a week apart, at four 3T MRI sites). The harmonized MRI protocol included two 3D-T1, a 3D-FLAIR, and a high-resolution 2D-T2. After within-session T1 averaging, subfield volumes were segmented using three pipelines with different multispectral data: two longitudinal (“long_T1s” and “long_T1s_FLAIR”) and one cross-sectional (“long_T1s_FLAIR_crossT2”). Volume reproducibility was quantified in magnitude (reproducibility error—RE) and space (DICE coefficient). RE was lower in all hippocampal subfields, except for hippocampal fissure, using the longitudinal pipelines compared to long_T1s_FLAIR_crossT2 (average RE reduction of 0.4–3.6%). Similarly, the longitudinal pipelines showed a higher spatial reproducibility (1.1–7.8% of DICE improvement) in all hippocampal structures compared to long_T1s_FLAIR_crossT2. Moreover, long_T1s_FLAIR provided a small but significant RE improvement in comparison to long_T1s (p = 0.015), whereas no significant DICE differences were found. In addition, structures with volumes larger than 200 mm3 had better RE (1–2%) and DICE (0.7–0.95) than smaller structures. In summary, our study suggests that the most reproducible hippocampal subfield FreeSurfer segmentations are derived from a longitudinal pipeline using 3D-T1s and 3D-FLAIR. Adapting a longitudinal pipeline to include high-resolution 2D-T2 may lead to further improvements

Quantitative MRI Harmonization to Maximize Clinical Impact: The RIN-Neuroimaging Network

Neuroimaging studies often lack reproducibility, one of the cardinal features of the scientific method. Multisite collaboration initiatives increase sample size and limit methodological flexibility, therefore providing the foundation for increased statistical power and generalizable results. However, multisite collaborative initiatives are inherently limited by hardware, software, and pulse and sequence design heterogeneities of both clinical and preclinical MRI scanners and the lack of benchmark for acquisition protocols, data analysis, and data sharing. We present the overarching vision that yielded to the constitution of RIN-Neuroimaging Network, a national consortium dedicated to identifying disease and subject-specific in-vivo neuroimaging biomarkers of diverse neurological and neuropsychiatric conditions. This ambitious goal needs efforts toward increasing the diagnostic and prognostic power of advanced MRI data. To this aim, 23 Italian Scientific Institutes of Hospitalization and Care (IRCCS), with technological and clinical specialization in the neurological and neuroimaging field, have gathered together. Each IRCCS is equipped with high- or ultra-high field MRI scanners (i.e., ≥3T) for clinical or preclinical research or has established expertise in MRI data analysis and infrastructure. The actions of this Network were defined across several work packages (WP). A clinical work package (WP1) defined the guidelines for a minimum standard clinical qualitative MRI assessment for the main neurological diseases. Two neuroimaging technical work packages (WP2 and WP3, for clinical and preclinical scanners) established Standard Operative Procedures for quality controls on phantoms as well as advanced harmonized quantitative MRI protocols for studying the brain of healthy human participants and wild type mice. Under FAIR principles, a web-based e-infrastructure to store and share data across sites was also implemented (WP4). Finally, the RIN translated all these efforts into a large-scale multimodal data collection in patients and animal models with dementia (i.e., case study). The RIN-Neuroimaging Network can maximize the impact of public investments in research and clinical practice acquiring data across institutes and pathologies with high-quality and highly-consistent acquisition protocols, optimizing the analysis pipeline and data sharing procedures

MRI data quality assessment for the RIN - Neuroimaging Network using the ACR phantoms

Purpose: Generating big-data is becoming imperative with the advent of machine learning. RIN-Neuroimaging Network addresses this need by developing harmonized protocols for multisite studies to identify quantitative MRI (qMRI) biomarkers for neurological diseases. In this context, image quality control (QC) is essential. Here, we present methods and results of how the RIN performs intra-and inter-site reproducibility of geometrical and image contrast parameters, demonstrating the relevance of such QC practice. Methods: American College of Radiology (ACR) large and small phantoms were selected. Eighteen sites were equipped with a 3T scanner that differed by vendor, hardware/software versions, and receiver coils. The stan-dard ACR protocol was optimized (in-plane voxel, post-processing filters, receiver bandwidth) and repeated monthly. Uniformity, ghosting, geometric accuracy, ellipse's ratio, slice thickness, and high-contrast detect -ability tests were performed using an automatic QC script. Results: Measures were mostly within the ACR tolerance ranges for both T1-and T2-weighted acquisitions, for all scanners, regardless of vendor, coil, and signal transmission chain type. All measurements showed good repro-ducibility over time. Uniformity and slice thickness failed at some sites. Scanners that upgraded the signal transmission chain showed a decrease in geometric distortion along the slice encoding direction. Inter-vendor differences were observed in uniformity and geometric measurements along the slice encoding direction (i.e. ellipse's ratio). Conclusions: Use of the ACR phantoms highlighted issues that triggered interventions to correct performance at some sites and to improve the longitudinal stability of the scanners. This is relevant for establishing precision levels for future multisite studies of qMRI biomarkers

Automatic multispectral MRI segmentation of human hippocampal subfields: an evaluation of multicentric test-retest reproducibility

Accurate and reproducible automated segmentation of human hippocampal subfields is of interest to study their roles in cognitive functions and disease processes. Multispectral structural MRI methods have been proposed to improve automated hippocampal subfield segmentation accuracy, but the reproducibility in a multicentric setting is, to date, not well characterized. Here, we assessed test-retest reproducibility of FreeSurfer 6.0 hippocampal subfield segmentations using multispectral MRI analysis pipelines (22 healthy subjects scanned twice, a week apart, at four 3T MRI sites). The harmonized MRI protocol included two 3D-T1, a 3D-FLAIR, and a high-resolution 2D-T2. After within-session T1 averaging, subfield volumes were segmented using three pipelines with different multispectral data: two longitudinal ("long_T1s" and "long_T1s_FLAIR") and one cross-sectional ("long_T1s_FLAIR_crossT2"). Volume reproducibility was quantified in magnitude (reproducibility error-RE) and space (DICE coefficient). RE was lower in all hippocampal subfields, except for hippocampal fissure, using the longitudinal pipelines compared to long_T1s_FLAIR_crossT2 (average RE reduction of 0.4-3.6%). Similarly, the longitudinal pipelines showed a higher spatial reproducibility (1.1-7.8% of DICE improvement) in all hippocampal structures compared to long_T1s_FLAIR_crossT2. Moreover, long_T1s_FLAIR provided a small but significant RE improvement in comparison to long_T1s (p = 0.015), whereas no significant DICE differences were found. In addition, structures with volumes larger than 200 mm3 had better RE (1-2%) and DICE (0.7-0.95) than smaller structures. In summary, our study suggests that the most reproducible hippocampal subfield FreeSurfer segmentations are derived from a longitudinal pipeline using 3D-T1s and 3D-FLAIR. Adapting a longitudinal pipeline to include high-resolution 2D-T2 may lead to further improvements